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(54) Mapping system for the integration and graphical display of pipeline information that 
enables automated pipeline surveillance 



(57) Pipeline data and satellite data are used to pro- 
vide surveillance for a pipeline. The satellite data is inte- 
grated with the pipeline data to produce a current 
pipeline map. The current pipeline map is then com- 
pared with a previous pipeline map to determine 
whether the route of the pipeline or a surrounding envi- 



ronment of the pipeline has changed. The satellite data 
includes very high resolution (VHR) satellite imagery 
and the pipeline data includes location data that is a 
series of global positioning system (GPS) coordinates. 
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Description 

CROSS-REFERENCE TO RELATED APPLICATIONS 
[0001] Not applicable. 

STATEMENT REGARDING FEDERALLY SPON- 
SORED RESEARCH 

[0002] Not applicable. 

BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

[0003] The present invention relates to a pipeline 
mapping system for comparing and graphically display- 
ing integrated pipeline information without the need for 
ongoing, periodic aerial surveillance. 

2. Description of the Related Art 

[0004] Pipelines are widely used in a variety of indus- 
tries and allow material to be transported from one loca- 
tion to another. A variety of fluids such as oil, gas, 
particulates, and other small solids suspended in fluids 
are transported using pipelines. In a typical application 
a pipeline carries a large quantity of oil products under 
pressure. Frequently, pipelines carry these products at 
high temperature and at high flow rates. Many pipelines 
are also routed through environments and carry prod- 
ucts that affect the vitality of the pipeline. Environmental 
factors or transported products may result in, among 
other things, pipeline corrosion. 
[0005] Pipeline corrosion, if not detected and reme- 
died, can result in release of a pipeline's contents into a 
surrounding environment. Soil subsidence, local con- 
struction projects, seismic activity, weather, and degra- 
dation caused by normal use can also lead to defects 
and anomalies in a pipeline. In addition, harsh environ- 
ments can cause pipelines to move gradually over time 
thus making later detection of buried pipelines difficult. 
These shifts in the pipeline location can also lead to 
defects, cracks, leaks, bumps, and other anomalies in 
the pipeline. 

[0006] The internal and external surface walls of a 
pipeline are susceptible to damage by various factors. 
These factors may include: reactivity to the material 
flowing through the pipeline; pressure, temperature and 
chemical characteristics of various products and con- 
taminants inside and outside the pipeline; corrosion; 
mechanical damage; fatigue; cracks; stress; distortion 
due to dents or wrinkles; exposure; and damage due to 
weight coating and free spanning of offshore pipelines. 
Moreover, submarine pipelines face additional hazards 
which include ship anchors, troll boards, and seabed 
scouring due to strong currents. While timely repair or 
maintenance of pipelines can lengthen the service life- 



time of the pipeline, a rupture or serious leak within the 
pipeline can be difficult and expensive to repair. Further, 
in the early stages the exact position of the rupture may 
be difficult to locate. 

5 [0007] The identification and location of defects and 
anomalies is crucial to pipeline maintenance. Identifying 
these faults in a buried pipeline is problematic when the 
location of the buried pipeline cannot be readily ascer- 
tained. As previously stated, many of the environmental 

10 stresses on the pipeline that cause defects and anoma- 
lies to appear in the pipeline can also shift the pipeline 
location. This is particularly true of very long pipelines. 
[0008] Traditionally, pipeline operators have used var- 
ious surveillance techniques to check for pipeline 

is defects and encroachment. One such technique has 
involved aerial surveillance (utilizing an airplane or heli- 
copter) to check for pipeline defects and encroach- 
ments. A disadvantage of aerial surveillance arises from 
its cost and concern for the safety of the persons per- 

20 forming the aerial surveillance. Another, less widely 
used surveillance technique has involved a person tra- 
versing a pipeline. The cost of this technique in terms of 
personnel and time is very high. 
[0009] In addition to surveillance, traversing (or walk- 

25 ing) a pipeline has also been used to locate or map the 
pipeline. When mapping a pipeline by traversing the 
pipeline route, a survey crew located the pipeline and 
took numerous global positioning system (GPS) read- 
ings along the pipeline route. These GPS coordinates 

30 were then stored for later display or visualization of the 
pipeline route. Again, pipeline survey crews were 
expensive and the task was time consuming. 
[0010] Satellite and airborne imaging systems have 
also been utilized for various mapping tasks. Satellite 

35 imaging systems have been available for a number of 
years, but high resolution images have not been com- 
mercially available. High resolution images provided by 
such satellite imaging systems can provide information 
that can be useful in geographical mapping. One such 

40 satellite system with the capability of providing high res- 
olution images is known as very high resolution (VHR) 
satellite imagery. VHR satellite imagery is scheduled to 
soon be available from a growing number of such satel- 
lites. The information contained within VHR satellite 

45 imagery is known to have a spatial resolution of approx- 
imately 1 meter. 

[0011] Various geographic information system (GIS) 
software packages are commercially available for view- 
ing images. One such package is IMAGINE®, a product 

so of the Erdas Corporation based in Atlanta, Georgia, 
which provides a Windows based image analysis and 
processing package. IMAGINE® provides for visual 
analysis of data and is capable of displaying, geo-cor- 
recting, and reprojecting that data. 

55 [0012] Software packages that are directed to the 
presentation of pipeline inspection information are 
known and commercially available. One such package 
is PipeVision, a product of Pipeline Integrity Interna- 
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tionat Ltd., assignee of the present invention. Pipe Vi- 
sion presents existing pipeline inspection information in 
graphical and report formats. 

SUMMARY OF THE INVENTION 5 

[0013] The present invention provides a technique 
that utilizes pipeline data and satellite data for surveying 
or providing surveillance for a pipeline. The satellite 
data is integrated with the pipeline data to produce a 10 
current pipeline map. The current pipeline map can then 
be compared with a previous pipeline map to determine 
whether the route of the pipeline or a surrounding envi- 
ronment of the pipeline has changed. In a disclosed 
embodiment, the satellite data is very high resolution is 
(VHR) satellite imagery and the pipeline data includes 
location data that is a series of global positioning sys- 
tem (GPS) coordinates. 

[001 4] Pipeline data from several sources, can also be 
integrated. The present invention provides for auto- 20 
mated pipeline surveillance without requiring routine, 
periodic surveillance from an airplane or helicopter tra- 
versing the pipeline route. This reduces surveillance 
costs and alleviates safety concerns for those persons 
performing the aerial surveillance. 25 

BRIEF DESCRIPTION OF THE DRAWINGS 

[001 5] A better understanding of the present invention 
can be obtained when the following detailed description 30 
of the preferred embodiment is considered in conjunc- 
tion with the following drawings that are illustrative of an 
embodiment of the present invention, in which: 

Figure 1 illustrates a typical pipeline and the various 35 
apparatus that can be utilized in obtaining relevant 
pipeline data; 

Figure 2 illustrates a typical computer system S for 
implementing a pipeline mapping system according 
to the present invention; 40 
Figure 3 is a block diagram depicting various func- 
tions performed by the pipeline mapping system 
according to the present invention; and 
Figure 4 is a flow chart associated with a pipeline 
tracking routine used in the present invention. 45 

DETAILED DESCRIPTION OF PREFERRED EMBOD- 
IMENT 

[001 6] The present invention provides a pipeline map- so 
ping system implemented in a computer system that uti- 
lizes pipeline data and satellite data to provide 
automated surveillance for a pipeline. The satellite data 
is integrated with the pipeline data to produce a current 
pipeline map. The current pipeline map can then be ss 
compared with a previous pipeline map to determine 
whether the route of the pipeline or a surrounding envi- 
ronment of the pipeline has changed. In a disclosed 



embodiment, the satellite data is very high resolution 
(VHR) satellite imagery and the pipeline data includes 
location data that is a series of global positioning sys- 
tem (GPS) coordinates. The present invention provides 
for pipeline surveying or surveillance without requiring 
routine, periodic surveillance from an airplane or heli- 
copter traversing the pipeline route. This reduces sur- 
veillance costs and alleviates safety concerns for those 
persons performing the aerial surveillance. 

Pipeline Location Data 

[001 7] The preferred technique used to obtain location 
data along a pipeline for processing according to the 
present invention is initiated by inserting a map- 
ping/inspection vehicle (MIV) within the pipeline. The 
MIV inspects the interior of the pipeline and maps the 
pipeline's location-that is the pipeline's curvature or 
profile. Such a MIV is typically integrated within a pipe- 
line pig 40 (see Fig. 1). One example of a MIV for locat- 
ing and evaluating a pipeline is entitled METHOD AND 
APPARATUS FOR DETERMINING LOCATION OF 
CHARACTERISTICS OF A PIPELINE, by Tuck, et al. 
U.S. application Serial No. 08/996,504, filed December 
23, 1 997, assigned to the assignee of the current inven- 
tion which is hereby incorporated by reference. 
[0018] In U.S. application Serial No. 08/996,504, 
magloggers also known as "loggers" are used in combi- 
nation with the MIV to map the pipeline. Magloggers 30 
of this type are shown at spaced locations along the 
earth's surface near the pipeline 1 0. The magloggers 30 
are located along the pipeline 10 to provide pipeline 
data used in post-processing routines. A given maglog- 
ger's location is determined through the use of differen- 
tial GPS satellite techniques. The data from the 
particular maglogger 30 is then correlated to location 
data from the MIV in an analysis stage. 
[0019] The magloggers 30 each contain a highly pre- 
cise clock that is synchronized to a similar clock within 
the MIV in the pipeline pig 40. Using a fluxgate magne- 
tometer and a recording device, each maglogger 
detects the approach of the MIV along the pipeline and 
detects the passage of the MIV by measuring the mag- 
netic signature of the MIV passing through the pipeline. 
The exact time the MIV passes is stored within the 
maglogger with each data value being separately time- 
tagged. 

[0020] Also, magnetic sensors within the MIV detect 
structural defects and anomalies within the pipeline as 
discrete events. The MIV also contains an inertial meas- 
urement unit (IMU) having both gyroscopic and acceler- 
ometer sensors. Further, the MIV includes an odometer 
for measuring the distance traveled by the MIV. The 
MIV's clock is also utilized to record the time at which an 
anomaly or defect is detected. The detection of defects 
and anomalies by the MIV can be translated to location 
not only in terms of an odometer reading, but also in 
terms of the distance to each maglogger. The gyro- 
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scope and accelerometer sensors within the IMU, in 
combination with the odometer and the loggers, pro- 
vided the location of anomalies in terms of geographic 
position. 

[0021] After the pipeline data is obtained, the pipeline 
data is downloaded from the magloggers 30 and the 
MIV into a computer system (see Fig. 2). The post- 
processing software routines disclosed in U.S. applica- 
tion Serial No. 08/996,504, also include a set of soft- 
ware processes for analyzing and correlating the 
pipeline data. Moreover, because the location of the log- 
ger is known in terrestrial coordinates such as longi- 
tude, latitude, and altitude (or other similar land 
measure) the location of any defect can be reported in 
such coordinates to avoid walking the pipeline. Through 
this technique repair teams can use differential GPS 
signals to locate defects whh a high degree of accuracy. 
A repair team having a first GPS sensor at a known 
location can use signals received from the GPS satel- 
lites operated by the United States military to accurately 
locate a given point. 

Primary Data 

[0022] A pipeline map is primarily derived from pipe- 
line location data and VHR satellite imagery. Pipeline 
location data can be provided by any method so long as 
the pipeline location data is either provided as or is con- 
vertible into a series of GPS coordinates. Various meth- 
ods for obtaining the pipeline location data in GPS 
coordinates may be used, and the exact technique is 
not critical to the invention. Dwelling and transport (i.e., 
road and railroad) locations are provided by satellite 
imagery and can be utilized in thejntegration of the pri- 
mary data. Turning to Figure 1, the typical pipeline 10 is 
shown along with various apparatus that can be utilized 
in addition to the magloggers 30 to obtain relevant pipe- 
line data. For example, using GPS satellites 20 to accu- 
rately locate magloggers 30 allows data from a MIV to 
be more readily integrated with data obtained from a 
VHR satellite 50. Integrating these various data 
obtained from those sources according to the pipeline 
mapping system of the present invention, allows for 
enhanced mapping of the pipeline 10. The pipeline 
mapping system utilizes various data sources and files. 
These data sources furnish the data they obtain as input 
to the pipeline mapping system. The pipeline mapping 
system manipulates the data sources and generates 
the output data which is the basis for a pipeline map. 
[0023] The VHR satellite imagery from the satellite 50 
is furnished in the form of raster files which contain sat- 
ellite imagery of the area encompassing the pipeline 10 
of interest. The amount and content of imagery data 
from satellite 50 depends on the ground coverage, spa- 
tial resolution, and number of bands provided by the 
VHR satellite imagery. A VHR satellite imagery provid- 
ing a suitable sized ground coverage (such as an 1 1 kil- 
ometer x 2 kilometer image in North America) is 



normally available to provide a reasonable corridor of 
ground cover on both sides of the pipeline 10. 
[0024] Typical VHR satellite imagery formats include: 
1 meter spatial resolution panchromatic, 4 meter spatial 

5 resolution multi-spectral, 1 meter spatial resolution pan- 
sharpened color containing three bands (the three 
bands are red, green, and blue (RGB)), and 1 meter 
spatial resolution pan-sharpened multi-spectral contain- 
ing four bands (the four bands are RGB and near infra- 

10 red (NIR)). As a general rule, either the 1 meter spatial 
resolution pan-sharpened three band product or four 
band product are adequate for generating pipeline 
maps. The primary difference between the three and 
four band products is the NIR band. The NIR band may 

15 be useful in locating and tracking the pipeline route in 
the satellite imagery under certain ground conditions. 
[0025] VHR satellite imagery with a spatial resolution 
of 1 meter is also helpful in detecting and mapping indi- 
vidual dwellings, vehicles, and above ground pipeline 

20 related features such as compressor stations and pig 
trap compounds. The ability to identify dwellings and 
vehicles allows issues such as encroachment and exca- 
vation work in the vicinity of the pipeline to be automati- 
cally identified. Since VHR satellite imagery is 

25 scheduled to be available worldwide every three days, 
VHR satellite imagery, can among other things, provide 
data for monitoring pipelines for terrorist activity and 
third party damage. The ability to perform surveying or 
surveillance of a pipeline using the pipeline mapping 

30 system reduces the need for aerial surveillance. As pre- 
viously stated, this allows a pipeline operator to reduce 
related monitoring costs. The infrared information con- 
tained within VHR satellite imagery is potentially useful 
for detecting methane related vegetation damage, 

35 which can be caused by pipeline leakage. The stereo 
VHR satellite imagery form allows terrain information, 
such as slope, to be determined. 
[0026] In the preferred embodiment, the starting point 
is pipeline data available from the magloggers 30 or 

40 other sources as part of the standard pipeline logging 
and inspection procedures. That pipeline data includes 
records for each girthweld, offtake, logger, bend, and 
detected pipeline defect of the inspected pipeline 10. 
The records may include the following information about 

45 points of interest in the pipeline: weld number, relative 
distance, absolute distance, internal/external indicator, 
feature comment, percent defect, axial extent (mm), 
unknown, orientation, longitude (degrees), latitude 
(degrees), and altitude. The girthweld records are typi- 

50 cally provided in a form including longitude and latitude 
values for their location. 

[0027] Two feature types that are used if available 
within the pipeline mapping system of the present 
invention are girthweld and logger data. At times the 
55 pipeline inspection data may only contain GPS informa- 
tion for girthwelds. In this case, location information for 
other features would be derived by interpolation 
between girthwelds. The girthweld features may 
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include: the weld number which indicates the girth weld 
sequence number, the absolute distance of the weld 
from the start of the inspected section of pipeline, and 
an indication that it is a girth weld. The longitude and lat- 
itude values represent the spatial location of the weld as 5 
determined from the IMU ( as disclosed in U.S. Applica- 
tion serial no. 08/996,504. For loggers the absolute dis- 
tance indicates the distance of the logger from the start 
of the inspected section and the longitude and latitude 
give the logger's spatial location. The logger's weld field 70 
contains the weld number of the upstream girthweld. 
[0028] Other features that are potentially useful for 
data correlation include large diameter offtakes and 
other discernable features that aid the data integration 
process. However, latitude and longitude coordinates 15 
are not typically available for these record types. As 
above, coordinates for these features are normally 
determined by interpolation between the upstream and 
downstream girthwelds using the relative distance 
measurements or calculations which show the distance 20 
of a feature from the upstream girthweld. For example, 
defects and any discernable pipeline feature can be 
included in the pipeline map if desired. Using the pipe- 
line mapping system, detected defects and encroach- 
ments can be given real geographical location and 25 
displayed within a satellite image or strip map. 

Computer System 

[0029] Turning to Figure 2, illustrated is a computer 30 
system S for mapping a pipeline according to an 
embodiment of the invention. While this system is illus- 
trative of one embodiment, the techniques according to 
the invention can be implemented in a wide variety of 
systems, such as a mainframe or workstation. The com- 35 
puter system S in the illustrated embodiment is a per- 
sonal computer in the form of a peripheral component 
interconnect (PCI) bus/industry standard architecture • 
(ISA) bus based machine, having a PCI bus 102 and an 
ISA bus 104. 40 
[0030] The PCI bus 102 couples a variety of devices 
that generally take advantage of a high speed data path. 
This includes a small computer system interface (SCSI) 
controller 122 for controlling a disk 124, which can be a 
compact disk-read only memory (CD-ROM). A chipset 45 
106 provides a host-PCI bridge which couples the PCI 
bus 102 to a host bus 110 and a processor 108. The 
chipset 106 also provides a memory controller for con- 
trolling memory 114 and an accelerated graphics port 
(AGP) for connecting a graphics card 112. The memory so 
114 includes an application appropriate amount of 
dynamic random access memory (DRAM). A second 
bridge circuit, a PCI-ISA bridge 1 18 couples the PCI 
bus 102 to the ISA bus 104. 

[0031 ] The chipset 1 06 can be a 440BX AGPset man- 55 
ufactured by the Intel Corporation. The PCI-ISA bridge 
1 18 can be a PIIX4, also manufactured by the Intel Cor- 
poration. The PCI-ISA bridge 118 can include an inter- 



nal enhanced intelligent drive electronic (IDE) controller 
for controlling up to four enhanced IDE drives (not 
shown), and a universal serial bus (USB) controller for 
controlling USB ports (not shown). The ISA bus 104 
couples the PCI-ISA bridge 1 1 8 to a Super I/O chip 1 28, 
which can be a National Semiconductor Corporation 
PC87307VUL device. This Super IAD chip 128 provides 
a variety of input/output functionality, including a key- 
board controller for a keyboard 132 and a mouse port 
for a mouse 130. 

[0032] The processor 1 08 can be a Pentium II® proc- 
essor. The Pentium II® processor could be replaced 
with different processors without detracting from the 
spirit of the invention. The processor 108 is capable of 
running any of a number of operating systems, such as 
Windows 95®, Windows NT®, or a Unix based operat- 
ing system. Finally, a video display 12Q is coupled to the 
graphics card 1 12 for display of graphics by the compu- 
ter system S. 

[0033] The computer system S is not critical to the 
present invention but should minimally include the capa- 
bilities of a systems that has: a 133 MHz Pentium® 
processor, 128MB of DRAM, a seventeen inch video 
display with a 0.3mm dot pitch, a super video graphics 
array (SVGA) video card with a 24 bit pixel depth, and a 
CD-ROM. 

Secondary Data 

[0034] Various secondary data can be displayed on a 
pipeline map (derived from the primary data) using the 
pipeline mapping system of the present invention. This 
secondary data includes other pipeline features as 
described below and enables a pipeline operator to dis- 
play those pipeline features of interest. As previously 
mentioned, the pipeline mapping system can be 
adapted to provide geographical integration of other 
information which could include engineering strip maps 
and ground property maps (such as soil and geology). 
Integrating this information can provide detailed digital 
maps of the pipeline and its proximity and provide infor- 
mation concerning habitation (i.e., population density) 
and transport (i.e., roads and railroads). This ability to 
integrate additional data provides the pipeline operator 
access to other potentially valuable pipeline data. 
[0035] The ability to detect ground movement can pro- 
vide valuable information in areas where mining subsid- 
ence and landslides are a primary threat to pipeline 
integrity. Data derived from synthetic aperture radar 
(SAR) imagery can be used to interpret ground move- 
ment and can potentially be integrated within a pipeline 
map. In addition, information derived from a number of 
new aircraft systems are relevant to pipeline manage- 
ment and can also potentially be integrated within a 
pipeline map. Laser systems which measure ground 
height to an accuracy of 5-10 cm are well suited to pro- 
vide data concerning flood risk potential, subsidence, 
and landslip. Airborne spectrometers are available 
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which gather very accurate properties of ground cover. 
This information is particularly suited to characterizing 
the chemical properties of soil (i.e., pH). Thermal sen- 
sors measure ground temperature and enable the 
detection of temperature anomalies. Available thermal 
sensors are very sensitive and typically produce data 
with temperature sensitivities of 0.1 °C. Using these sen- 
sors, temperature and pH anomalies may be used to 
detect leakage along the pipeline 10. 
[0036] Further, information concerning terrain proper- 
ties such as elevation, slope, and land cover can be 
acquired. Land cover may include whether the ground 
cover is forest, arable, marshland, water, moor land, 
estuary land, covered by buildings or densely popu- 
lated. Further, the information can potentially identify 
drainage, moisture content of the soil, the type of under- 
lying soil, and the land's geological characteristics. This 
information can allow proposed route evaluations to be 
made in a much more cost-effective manner than con- 
ventional surveying. As previously stated, the pipeline 
mapping system can potentially be used to generate 
habitation density and transport density maps which 
could also be used by the pipeline operator for pipeline 
safety studies. A pipeline operator's defect database 
and information from recent inspection surveys can be 
combined with satellite image data, geology, soils, and 
drainage information. Satellite data can also be inte- 
grated with pipeline inspection data to produce high 
accuracy pipeline route maps for generating or updating 
stripmaps. Further, the pipeline mapping system can 
potentially integrate data on any pipeline feature of 
interest. 

[0037] Integrating VHR satellite imagery with the pipe- 
line mapping system may be helpful in identifying vari- 
ous features in the vicinity of the pipeline. This enables 
the pipeline mapping system to identify changes in sur- 
rounding features by comparing previous pipeline maps 
with current pipeline maps. In a similar manner, the 
pipeline mapping system can also compare stripmaps 
with air photos and/or satellite images from a number of 
dates and use this to ascertain whether changes have 
occurred. These detectable changes may include the 
presence of new construction, evidence of recent land 
slides, evidence of recent fires, or evidence of recent 
flooding. Whether the exact cause of the change can be 
identified is dependent on the resolution of the satellite 
image and the total area encompassing the change (i.e. 
size of the feature). 

[0038] Pipeline inspection data can be from a previous 
or current inspection of the pipeline and could include 
information on cathodic protection (CP) locations, coat- 
ing types, wall thickness, pipewall materials, and the 
location and scale of detected defects. Previous inspec- 
tion information can also be compared with current 
inspection information. Whether the inspection data is 
held by the pipeline operator or the map service pro- 
vider, the pipeline mapping system can import the 
inspection data (depending on the format) and annotate 



the pipeline map accordingly. This information can 
greatly improve a pipeline operator's understanding of 
the nature of defect distributions and the need for CP 
protection when correlated to the pipeline route. 
5 [0039] Pipeline fixtures and fittings, such as valves 
and offtakes, are likely to be known to a pipeline opera- 
tor or can be identified as part of a pipeline inspection. 
Enhancing the pipeline map with such information 
greatly improves the pipeline operator's ability to under- 
go stand their pipeline map and pipeline. Readily accessi- 
ble information on whether the ground in which the 
pipeline is laid is consolidated, wet, marshy or other- 
wise can assist in pipeline integrity studies or in high- 
lighting areas of concern. Classification of the land use 
is may exist in a pipeline operator's databases or could be 
derived using image analysis techniques from the VHR 
satellite imagery. 

[0040] Elevation data for the area surrounding the 
pipeline can be derived from multiple satellite images. 
20 Elevation data derived from the satellite imagery nor- 
mally provides for a greater understanding of the pipe- 
line and its environment. VHR satellite imagery in 
combination with information on land classification and 
soil condition may assist engineering judgements relat- 
es ing to potential integrity threatening events, such as 
land slippage. In its most basic form, this additional data 
can be provided as contours overlaid on the pipeline 
route and ground imagery. In a more complex form a 
digital elevation model (DEM) enabling 3D representa- 
30 tion of the route of the pipeline can be implemented. 

Functions Of The Mapping System 

[0041] Figure 3 is a block diagram depicting various 
35 functions performed by the pipeline mapping system. In 
its basic form the pipeline mapping system imports VHR 
satellite imagery 300 and pipeline location data 304. 
The VHR satellite imagery 300 of the type described 
above is obtained from satellite 50, while the pipeline 
40 location data 304 comes from magloggers 30 and other 
sources described above. Other data sources 320 as 
indicated can also, where available, be integrated with 
the pipeline mapping system. The data sources 320 are 
the previously mentioned secondary data sources, such 
45 as aerial photograph imagery, compact airborn spec- 
trometer instrument (CASI) imagery, thermal imagery, 
and soil and geology based data. 
[0042] Upon input to the pipeline mapping system the 
pipeline location data and VHR satellite imagery is tor- 
so matted, as required (see steps 302 and 306). The sec- 
ondary data sources, when imported, are also 
formatted as required in step 322. The data formatting 
may also include editing the data. The pipeline mapping 
system functions to enable the user to process and 
55 modify the various data sources used in the generation 
of the satellite based maps prior to the final integration 
and mapping processes. Capabilities include: geo-refer- 
encing of VHR satellite imagery after import, color bal- 
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ancing of VHR satellite imagery, editing the raster 
values in VHR satellite imagery, conversion of coordi- 
nates from one map projection system to another, and 
editing various file data. 

[0043] In step 308 the pipeline is tracked in the VHR 
satellite imagery (see Fig. 4). The pipeline mapping sys- 
tem tracks a pipeline and locate points where distinctive 
pipeline features can be detected in the satellite 
images. These points can then be used along with any 
visible or ascertainable GPS locations in the imagery 
(i.e., where loggers were located) to assist the integra- 
tion of the imagery with the pipeline location data. The 
pipeline mapping system implements a mapping inter- 
face which allows tracking to be carried out interactively 
by the end user. This approach is proven and common 
within the seismic processing industry, where image 
based tracking is required along complex geological 
features. 

[0044] The pipeline tracker is a tool that can be called 
upon when the VHR satellite imagery lacks sufficient 
GPS locations to enable the VHR imagery to be regis- 
tered to the pipeline location data. When utilized the 
pipeline tracker provides a means of locating other 
GCPs that can then be used to register the VHR satel- 
lite imagery to the pipeline location data. In general, a 
GCP is any point in the VHR satellite imagery that can 
be mapped to a specific point along the route of the 
pipeline. For example, offtakes and bends in the pipe- 
line may be located in the VHR satellite imagery. These 
points can then be used for registration of the VHR sat- 
ellite imagery to the pipeline location data. 
[0045] A disclosed embodiment of the pipeline tracker 
functions in three related parts. In the first part, a user 
locates a point in an image using a searcher. This is ini- 
tiated by the user selecting a first point and a second 
point and then initiating the search. Using a tracking 
technique disclosed below the searcher finds the best 
indication of the pipeline between the first and second 
points. This process is repeated using two other points 
to generate another point in the imagery where the 
pipeline is detected. These two end points in the 
imagery, that are located using the searcher, are then 
used as seed locations for the second part of the proc- 
ess. These end points are detected using the tracking 
technique further discussed below. In the second part of 
the process, the pipeline tracker tracks the route 
between the two end points and displays the tracked 
route as an overlay on the satellite imagery. In the third 
part, a ground control point (GCP) on the tracked route 
can be selected and digitized for use in a later integra- 
tion stage. 

[0046] In another embodiment, the tracker is applied 
within a 10-20 meter corridor orthogonal to a known 
pipeline route. In this embodiment the tracker tracks 
from a launch point. As such there is no need to manu- 
ally specify two points from which to start the process. 
The tracker works its way along the corridor identifying 
sections, which represent (to a high probability) the 



pipeline. In this manner, the tracker normally detects 
features that allow registration. 
[0047] Which point to digitize is a matter of finding a 
corresponding identifiable feature in the satellite image. 

5 In a typical situation, such points are likely to be large 
diameter offtakes and large angle bends with a small 
rate of change (ROC). The method of choosing two 
points for the first step in the process may involve over- 
laying the imagery with the route of the pipeline to give 

w a crude indication of where the pipeline and any identi- 
fiable pipeline features are likely to exist in the imagery. 
Once these are visually identified, searches and track- 
ing can be targeted more precisely. 
[0048] In step 310 the formatted data (306, 308, and 

is possibly 322) is merged to create a current pipeline 
map. The process involves the transformation of the sat- 
ellite imagery using ground control pojnts (GCP) so that 
the pipeline route is located accurately within the image. 
The imagery is registered to the pipeline location data 

20 (rather than the other way round) since the pipeline 
location data is more accurate in terms of absolute loca- 
tion. The following description of the data integration is 
illustrative and other embodiments could be readily 
implemented based on the description herein. 

25 [0049] The pipeline mapping system technique of inte- 
grating pipeline location data and VHR satellite imagery 
to produce a pipeline map strives to maximize both the 
relative accuracy between the pipeline route and sur- 
rounding ground imagery and the absolute accuracy of 

30 all points in the pipeline map. The pipeline route is posi- 
tioned with respect to ground features and absolute 
geographic position to maximize accuracy. The pipeline 
mapping system accommodates a number of potential 
scenarios, in terms of the available information, in the 

35 integration process. The following scenarios are appli- 
cable when pipeline data is obtained using the prior art 
MIV vehicle of U.S. application Serial No. 09/996,504. 
[0050] In a first scenario the maglogger locations are 
visible in the VHR satellite imagery and located at regu- 

40 lar intervals along the length of the pipeline from launch 
to receive point. If the magloggers are located at above 
ground installations (AGIs), then the likelihood is that 
the AGIs are visible and the position of a maglogger is 
identifiable as that of the AGI to within several pixels 

45 accuracy (approximately 2 meters). Using the AGIs to 
fix the location data within the VHR satellite imagery 
results in a pipeline map having minimum absolute 
errors. Magloggers spaced at 7 kilometer lineage 
points, where the point of placement within the AGI is 

so clearly identifiable in the imagery should produce abso- 
lute errors of no more than 4 meters at mid-lineage 
points. The accuracy of the pipeline map can potentially 
be improved if segments of the pipeline route between 
AGIs are resolvable in the VHR satellite imagery, using 

55 either automated or manual techniques. 

[0051] In a second scenario the maglogger locations 
are located at featureless points along the pipeline and 
therefore are not identifiable in the VHR satellite 
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imagery. The accuracy in the pipeline map then 
depends on the spread of detectable sections of the 
pipeline in the satellite imagery. The detectable sections 
of the pipeline, whether detected using automated or 
manual techniques, when combined with potential 
changes in the direction of the pipeline should assist the 
integration of the pipeline location data (particularly if 
magloggers are deployed at launch and receive pig 
traps). However, because of the cfifficulty of fixing points 
errors are likely to be greater than in the first scenario. 
These errors should be no worse than the previously 
stated accuracy of the VHR satellite imagery which is 
+/• 10 meters. 

[0052] In a third scenario maglogger locations are not 
identifiable in the VHF satellite imagery and the pipeline 
route cannot be resolved in the imagery In this sce- 
nario, the pipeline location data and VHR satellite 
imagery are integrated using only geographic coordi- 
nates. If the imagery has an accuracy of +/- 10 meters 
and the accuracy of the pipeline location data is approx- 
imately +/- 2 meters (assuming the deployment of 
magloggers approximately every 7 kilometers), then the 
absolute accuracy of the pipeline should be no worse 
than +/- 1 2 meters. 

[0053] In practice, it is unlikely that any one scenario 
would be applicable to an entire pipeline. Therefore, the 
accuracy along the length of the pipeline will normally 
vary depending on the circumstances of a given sec- 
tion. As a general rule, satellite images that identify 
maglogger locations for a particular pipeline section aid 
in the reduction of errors in adjacent pipeline sections 
where maglogger locations cannot be identified. 
[0054] Using the tracking techniques further 
described below allows a pipeline operator to register 
the VHR satellite imagery to the pipe location data, even 
when the pipeline route is not visible to the naked eye. 
The disclosed tracking technique can be implemented 
regardless of how the GPS coordinates for the pipeline 
were obtained and improves the accuracy of the VHR 
satellite imagery to approximately that of the GPS data 
at GPS coordinate locations. Registering the VHR satel- 
lite imagery to GPS pipeline location information allows 
the error in all of the three above scenarios to be 
reduced to approximately +/- 2 meters. 
[0055] The current pipeline map represents the most 
recent version of the status of the pipeline 10 along its 
length. The current pipeline map can be stored as 
shown in step 324. The current pipeline map can also 
be displayed as shown in step 318 or compared with a 
previous pipeline map 312 as shown in step 314. The 
ability to view a pipeline map normally needs to be avail- 
able to both a pipeline map service provider and a pipe- 
line operator. The ability to display a pipeline map on the 
screen with associated coordinates (Longitude/Lati- 
tude, Eastings/Northings, etc.) and allow a user to 
inquire about the geographic location of certain features 
visible in the displayed image is desirable. 
[0056] To enable efficient viewing of the pipeline route, 



the pipeline mapping system provides for, among other 
things, scrolling, panning, jumping to areas of interest 
zooming in, and zooming out. When other data sources 
(e.g. soil maps) are included these data sources are dis- 

5 played as overlays to the pipeline map, and therefore 
need associated geo-coordinates. The pipeline map- 
ping system can provide for switching data layers on 
and off, and allow inquiries by the user with respect to 
relevant additional data sources. For example, the user 

10 could request that the pipeline mapping system identify 
areas of high soil corrosivity along the pipeline route. 
The previous pipeline map 312 can be derived from any 
prior stored current pipeline map. The results of the 
comparison can be displayed as shown in step 316. 

15 

Tracking Techniques 

[0057] The presence of an underground structure 
such as a pipeline can affect the moisture patterns and 

20 vegetation growth in the surrounding terrain. In VHR 
satellite imagery buried structures typically manifest 
themselves as faint patterns on the ground. The ability 
to identify such pipeline features is desirable as it allows 
pipeline surveillance techniques to be automated. Iden- 

25 tifying buried structures in the VHR satellite imagery 
presents a difficult problem from the fact that the fea- 
tures that one wishes to identify are very subtle and they 
do not always manifest themselves as contrast edges or 
lines. Due to the faint ground patterns created by a bur- 

30 ied pipeline, it is very difficult to identify the structure 
using conventional edge and line detection methods. 
[0058] One approach that aids in the interpretation of 
the images is the use of nonlinear filters. Nonlinear fil- 
ters typically have better signal-to-noise characteristics 

35 than linear filters. A disadvantage of nonlinear filters is 
that they produce noisy outputs such that the identifica- 
tion of a true signal among a number of false maxima is 
difficult to ascertain in an automatic way. This is one 
reason that nonlinear filters have normally be used 

40 within the framework of a model-driven approach. In a 
model-driven approach one has some prior knowledge 
of the position of the edge and the maximum of the filter 
response is searched within a pre-specrfied range. 
Since a pipeline operator is typically interested in a par- 

45 ticutar section of a pipeline, it is possible to implement 
the tracker in a semi-automatic way. 
[0059] This allows a pipeline operator's a priori knowl- 
edge to be incorporated in the tracking process. Faint 
edges manifest themselves as the maxima of the abso- 

so lute value of the first derivative of a signal. Faint lines 
manifest themselves as maxima of the second deriva- 
tive of a signal. Faint edges are usually enhanced and 
detected using differentiating filters. Faint lines are 
enhanced and identified using filters that estimate the 

55 second derivative. As a general rule, the best results in 
terms of correct identification of the location of a linear 
feature and robustness to overground linear structures 
like roads and hedges is achieved with a median, mode 
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or trimmed contraharmonic mean filter applied to a 
green or a red band of an image. Formulas for the Lp 
mean filter and contraharmonic filter are illustrated 
below: 
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[0060] The trimmed contraharmonic filter is defined as 
follows: where the summation is over all the pixels in a 
panel of a triptych window, l(i,j) the discrete brightness 
levels of pixel (ij), and p' is a free parameter. For the Lp 
mean filter setting 'a(i)' equal to one and 'p' equal to five 
typically provides good results. For the contraharmonic 
mean filter setting 'p' equal to two typically provides 
good results. A trimmed contraharmonic filter is denom- 
inated as such because the summation is performed 
only for those pixel values within one standard deviation 
from the mean value. A Gaussian filter can be utilized 
with the trimmed contraharmonic filter to remove noise 
from the signal. 

[0061 ] Utilizing a tracker in this manner assumes that 
a pipeline operator can ascertain two points in an image 
section through which a liner feature (such as a pipe- 
line) passes. Initially, the tracker hypothesizes that the 
feature follows the direction of a straight line that passes 
through these two points. The tracker starts from both 
ends of the line segment and scans the image along a 
line orthogonal to the hypothesized direction of the fea- 
ture. Along all pixels of the scan line the output of the 
trimmed contraharmonic filter is computed and 
assigned to the central pixel. Due to noise several peaks 
may be identified in a filter's output along a single line of 
scanning. For each one of the first few points of tracking 
the peak which is closest to the assumed direction is 
picked. From the identification of the first few tracked 
points the tracker calculates a new updated version of 
the finer feature orientation treating the two ends inde- 
pendently. The tracker then fits each of the two sets of 
tracked points at the ends of the original hypothesized 
position of the feature with a least squares fining line. 
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[0062] To avoid the interference of outliers the tracker, 
in the preferred embodiment, uses the Ransac method 
for robust fining as described below. If *P' denotes the 
set of points that we want to fit with a straight line, the 
algorithm is the following: Select two points from 'P* ran- 
domly and determine the line V between them. For 
every point in *P* compute its distance to the line *L', and 
then determine the subset 'S' (consensus set) consist- 
ing of the points with distances less than a certain 
threshold 'E' (error tolerance). If the number of points in 
the consensus set *S' is greater is greater than a given 
threshold, compute the line that fits set 'S'. using the 
least square error method. Otherwise, repeat the above 
process until you find an appropriate consensus set 'S* 
or fail after a desired number of times. If no "good" set 
was found, select the largest consensus set found and 
compute the line using it. 

[0063] The tracker then proceeds by scanning the 
image from each end perpendicularly to the new 
hypothesized direction of the pipeline. These line seg- 
ments or branches approximately intersect at some 
point between the end points. The tracker allows the 
pipeline to have up to a single change of direction 
between two end points that are fixed and known a pri- 
ori. The tracker proceeds by tracking a few points, fitting 
with the tracked points with a least square error line, 
updating the orientations of tracking, and tracking 
again. Tracking stops when the intersection point to any 
two tracking directions coincide or is very close to one of 
the tracked points. At the end, each branch of the 
tracked feature is fitted with a least squares error line. 
[0064] As a general rule, the tracker can deal with the 
presence of strong edges crossing the pipeline or edges 
which are parallel to the structure and appear close to it 
(such as roads and railroads). The presence of these 
lines can influence the tracker if they appear very close 
to the initial selected end points, because they usually 
introduce noisy points in the tracking sequence. How- 
ever, once the tracker has computed a reasonable 
number of points, the presence of some noisy points 
can be easily resolved with the use of a robust fitting 
method (preferably the Ransac method). In addition, the 
pipeline operator can influence the tracking process by 
not picking end points in close proximity to such struc- 
tures. 

[0065] To reiterate, the tracker provides a semi-auto- 
matic method for tracking faint linear ground features 
(such as buried pipelines). The technique is driven by a 
user selecting end points where the pipeline is detecta- 
ble. The tracker subsequently tracks the feature for all 
points between the selected end points. The tracker 
makes the assumption that there is at most one change 
of direction in the features between the two selected 
end points. An advantage of the tracker is that it can 
identify the position of a pipeline in an image where it is 
not visible to the naked eye. For detection, a pipeline's 
pixels must exhibit some detectable difference from sur- 
rounding environmental pixels of the VHR satellite 
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imagery. 

[0066] This allows the satellite image to be accurately 
integrated With GPS pipeline location data, maintaining 
the accuracy of the GPS pipeline location data. This in 
turn allows a user to create accurate pipeline maps that 
can be stored for comparison to later acquired satellite 
images of the same pipeline section. Comparing previ- 
ous pipeline maps to current pipeline maps, using 
standard image analysis techniques, allows a user to 
perform surveillance of the pipeline automatically reduc- 
ing the need for aerial surveillance. 

Pipeline Tracking from Satellite Data 

[0067] Turning to Figure 4, a tracking routine 400 is 
illustrated. The tracking routine 400 implements step 
308 of Fig. 3. In step 402 a pipeline operator selects two 
points in the image where portions of a pipeline are 
detectable. The end points should be selected such that 
there is only one change of direction between end 
points. The tracker functions by moving a sequence of 
triptych windows along a straight search line between 
the selected points. A triptych window is composed of 
three panels: top, central, and bottom. The panel length 
of the triptych window affects the nonlinear filter's 
response. Since the goal is to obtain just one filter peak 
(minima or maxima depending on the filter) the length of 
the central panel must span, at a minimum, the pixel 
width of the pipeline. The optimal panel length is 
dependent on the pixel width of the pipeline section that 
is tracked (the width is dependent on the resolution of 
the satellite image). For a typical 1 meter resolution 
pipeline image, a panel length of 15 pixels and a panel 
width of 21 pixels provides good tracking results. 
[0068] When ground conditions are favorable (that is- 
-severaf days after rain in the area of interest), the point 
where a pipeline passes orthogonal to the search line 
can be located using this technique. The route of the 
pipeline is tracked by moving the search windows 
inward from two end points and applying robust regres- 
sion to smooth the obtained indications. As previously 
stated, this technique is functional even when a section 
of pipeline includes a change in direction due to a bend. 
[0069] In step 404, the tracker utilizes these end 
points to hypothesize a route (in the preferred embodi- 
ment-a straight line) between the end points. The 
tracker only aids in the registration process when it 
detects a change in direction in the pipeline. That is, 
without a change in direction there is no discernable 
feature that can be used as a GCR In step 406 the rou- 
tine 400 scans the image along a line orthogonal to the 
hypothesized route; In step 408 the scanned pixels are 
filtered, using one of the previously mentioned nonlinear 
filters to reduce noise. In step 410. the routine 400 
selects the pixels with peaks closest to the hypothe- 
sized route. In step 412 the tracked pixels are adjusted 
using a least squares fining line (preferably the Ransac 
method). 



[0070] The number of pixels to compute before track- 
ing a new direction is an important parameter. Updating 
the tracking direction after determining ten points pro- 
vides good results for a typical pipeline. In step 414 a 

5 new pipeline route is hypothesized based upon the 
selected pixels at which point control passes to step 
416. In step 416 control passes to step 418 if the 
tracked branches approximately intersect. Otherwise, 
control passes to step 406. In step 418 each tracked 

10 branch is fitted using a least squares error line before 
the routine 400 ends in step 420. 

Operation 

is [0071 ] As previously discussed, pipeline location data 
for a pipeline can be obtained in GPS coordinates 
through various techniques. For example, pipeline loca- 
tion data can be captured for the entire route of the pipe- 
line either as part of an inspection or as a standalone 

20 run of the IMU disclosed in U.S. Application serial no. 
08/996,504. In any case, the obtained location data 
consists of data at discrete points down the entire length 
of the pipeline. These points serve to identify the overall 
route of the pipeline. The location data captured by the 

25 IMU disclosed in U.S. Application serial no. 08/996,504, 
consists of longitudes and latitudes in the WGS84 
frame, along with altitude information referenced to 
some base datum (e.g. sea level). The IMU can also 
provide an odometer reading showing the lineage from 

30 the start of the inspection for each set of coordinates. 
For the purpose of showing a plan route of the pipeline 
the only data of relevance are the longitude and latitude 
coordinates, though the altitude information could be 
used in three dimensional (3D) representations of the - - 

35 pipeline route. In this situation a digital elevation model 
(DEM) would normally be used as the basis for develop- 
ing the 3D visualization. 

[0072] The resolution of the location data from the 
IMU, disclosed in U.S. Application serial no. 08/996,504, 

40 is effectively the inter-scan frequency of the IMU. 
Although, the MIV is capable of providing location data 
every 10 centimeters down the length of the pipeline, in 
a typical application, data no more frequent than 1 
meter will be used, and it may be that data at every girth 

45 weld (approximately every 1 2.5m) is sufficient to meet a 
client's needs. This is primarily dependent on the needs 
of the pipeline operator and how the pipeline operator 
wants to represent the pipeline. As should be apparent, 
the frequency of the pipeline data will affect the speed 

so with which the pipeline route can be displayed. 

[0073] The accuracy of the data provided by the IMU 
is highly dependent on the frequency with which 
magloggers are deployed along the route of the pipe- 
line. At maglogger locations differential GPS readings 

55 are taken and used to reset the drift that naturally 
occurs within the longitude and latitude readings of the 
IMU. At maglogger locations the accuracy of the IMU 
location data is therefore limited by the accuracy of the 
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GPS used. Between adjacent magloggers the drift 
effect of the IMU introduces errors, which are a maxi- 
mum at the midiineage point. The size of these errors 
essentially depends on the lineage between the 
maglogger locations. As the distance is increased the 5 
error increases. With magloggers spaced at 7 km the 
stated accuracy of the IMU, disclosed in U.S. Applica- 
tion serial no. 08/996,504, is 1.5 meters rms. At any 
point along the pipeline route the stated accuracy of that 
point is within 1 .5 meters of its true location. 10 
[0074] The location coordinates of logger points can 
typically be said to have the accuracy of the GPS used 
to survey the logger locations. In the case of differential 
GPS, this accuracy is approximately 0.2 meter. At other 
locations, the accuracy of the location data is depend- 15 
ent on the spacing of the GPS loggers used to recali- 
brate the IMU data. The greatest inaccuracy (or 
uncertainty) occurs at mid-logger locations. Typically, 
the uncertainty is sinusoidal in nature with a maximum 
of approximately 3 meters at mid-logger locations and 20 
zero uncertainty at logger locations. 
[0075] The ground spatial resolution of the satellite 
imagery is estimated to be approximately 1m for pan- 
chromatic, and 4m for multi -spectral. Some products 
may be available which have both data types fused to 25 
produce pan-sharpened imagery having a spatial reso- 
lution of 1m, but including multispectral band data. The 
accuracy of such data is dependent on the particular 
product used, but could be as low as 1 2 meters. In most 
circumstances, the accuracy of the satellite data may be 30 
improved to approximately 2 meters using pipeline route 
GPS information. This accuracy allows for automated 
surveying or surveillance obviating the need for aerial 
reconnaissance. 

[0076] In practice, the satellite based pipeline map of 35 
an inspected pipeline can only be as accurate as the 
base data sources used to produce it. The data sources 
must be integrated so as to retain the inherent accuracy 
of the location data provided by the IMU, or other GPS 
data source, while ensuring that features present in 40 
both data sources are matched. The accuracy require- 
ments of the pipeline mapping system are pipeline oper- 
ator dependent. In the some situations, satellite 
imagery accurate to within 10 meters is adequate. 
[0077] If VHR satellite imagery scenes for a pipeline 45 
are available before deploying the MIV the pipeline 
route can be 'previewed' visually. This enables areas 
where the pipeline is not visible in the imagery to be 
identified; thus assisting the effective deployment of 
magloggers to minimize errors during the integration of so 
the location data with the satellite imagery. 
[0078] The foregoing disclosure and description of the 
invention are illustrative and explanatory thereof, and 
various changes in the details of the illustrated appara- 
tus and construction and method of operation may be ss 
made without departing from the spirit of the invention. 



Claims 

1. A method of providing surveillance for a pipeline, 
comprising the steps of : 

merging satellite data of the pipeline with exist- 
ing pipeline data to form a current map of a 
section of the pipeline; and 
comparing the current map with a previous 
map of the pipeline to detect relative changes 
between them. 

2. The method of claim 1 , wherein the satellite data 
provides ground features which can include roads, 
railroads, dwellings, vehicles, valve stations, and 
maglogger locations. 

3. The method of claim 1 , further comprising the steps 
of: integrating client data as overlays on the current 
map. 

4. The method of claim 3, wherein the client data can 
include pipeline inspection data, pipeline fixture 
data, pipeline fining data, soil condition data, land 
class data, and land elevation data. 

5. The method of claim 1 , wherein the existing pipe- 
line data includes pipeline location data, and 
wherein the merging step includes the steps of: 

tracking the section of the pipeline in the satel- 
lite data; and 

registering the satellite data to the pipeline 
location data such that the current map retains 
the accuracy of the pipeline location data. 

6. The method of claim 5, wherein the pipeline loca- 
tion data is a series of GPS coordinates. 

7. The method of claim 5, wherein the registering step 
includes the step of: 

capturing a ground control point (GCP) in the 
satellite data, wherein the GCP is utilized to 
facilitate merging of the satellite data and the 
pipeline location data. 

8. The method of claim 5, wherein the registering step 
is performed using a resample method and an inte- 
gration method. 

9. The method of claim 5, wherein the tracking step 
further comprises the steps of: 

(a) selecting two end points in the satellite 
image, wherein each of the two end points cor- 
respond to a tacking branch of the pipeline; 

(b) scanning pixels of the satellite image along 
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a line orthogonal to a straight line between the 
two end points, wherein the pixels are scanned 
from both of the end points; 

(c) filtering the scanned pixels using a non-lin- 
ear filter to identify peaks which indicate a route 5 
of the pipeline; 

(d) selecting the scanned pixels with a peak 
closest to the straight line between the two end 
points; 

(e) fining the selected pixels with a least 10 
squares fining line utilizing a robust fining 
method; 

(f) setting the two end points to the location of 
the last selected pixel for each of the tracking 
branches and repeating steps (b) through (0 is 
until the tracking branches approximately inter- 
sect; and 

(g) fining the tracking branches with a least 
squares error line utilizing the robust fining 
method. so 

10. The method of claim 9, wherein the selection of the 
two end points in step (a) is performed manually. 

1 1 . The method of claim 1 , wherein the satellite data is 25 
VHR satellite imagery. 

12. The method of claim 1, wherein the comparison 
step is automated using standard image analysis 
techniques. 30 

1 3. A computer system that provides for surveillance of 
a pipeline, the computer system comprising: 

a processor; 35 
a video display system coupled to the proces- 
sor; 

a mass storage device coupled to the proces- 
sor; and 

pipeline mapping code in a processor readable 40 
medium for causing the processor to perform 
the steps of: 

merging satellite data of the pipeline with 
existing pipeline data to form a current 45 
map of a section of the pipeline; and 
comparing the current map with a previous 
map of the pipeline to detect relative 
changes between them. 

50 

14. The computer system of claim 13, wherein the sat- 
ellite data provides ground features which can 
include roads, railroads, dwellings, vehicles, valve 
stations, and maglogger locations. 

55 

15. The computer system of claim 1 3, the pipeline map- 
ping code further comprising code for causing the 
processor to perform the step of: 



integrating client data as overlays on the cur- 
rent map. 

16. The computer system of claim 15, wherein the cli- 
ent data can include pipeline inspection data, pipe- 
line fixture data, pipeline fining data, soil condition 
data, land class data, and land elevation data. 

17. The computer system of claim 13, wherein the 
existing pipeline data includes pipeline location 
data, and wherein the merging step includes the 
steps of: 

tracking the section of the pipeline in the satel- 
lite data; and 

registering the satellite data to the pipeline 
location data such that the current map retains 
the accuracy of the pipeline location data. 

18. The computer system of claim 1 7, wherein the pipe- 
line location data is a series of GPS coordinates. 

1 9. The computer system of claim 1 7, wherein the reg- 
istering step includes the step of: 

capturing a ground control point (GCP) in the 
satellite data, wherein the GCP is utilized to 
facilitate merging of the satellite data and the 
pipeline data. 

20. The method of claim 17, wherein the registering 
step is performed using a resample method and an 
integration method. 

21. The computer system of claim 17, wherein the 
tracking step farther comprises the steps of: 

(a) selecting two end points in the satellite 
image, wherein each of the two end points cor- 
respond to a tracking branch of the pipeline; 

(b) scanning pixels of the satellite image along 
a line orthogonal to a straight line between the 
two end points, wherein the pixels are scanned 
from both of the end points; 

(c) filtering the scanned pixels using a non-lin- 
ear filter to identify peaks which indicate a route 
of the pipeline; 

(d) selecting the scanned pixels with a peak 
closest to the straight line between the two end 
points; 

(e) fining the selected pixels with a least 
squares fining line utilizing a robust fitting 
method; 

(f) setting the two end points to the location of 
the last selected pixel for each of the tracking 
branches and repeating steps (b) through (f) 
until the tracking branches approximately inter- 
sect; and 
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(g) fitting the tracking branches with a least 
squares error line utilizing the robust fitting 
method. 



22. The computer system of claim 21, wherein the s 
selection of the two end points in step (a) is per- 
formed manually. 

23. The computer system of claim 13, wherein the sat- 
ellite data is VHR satellite imagery. io 

24. The computer system of claim 13, wherein the com- 
parison step is automated using standard image 
analysis techniques. 

15 

25. A method of tracking a linear feature in a digital 
image, the method comprising the steps of: 

(a) selecting two end points in the digital image, 
wherein each of the two end points correspond 20 
to a tracking branch of the feature; 

(b) scanning pixels of the digital image along a 
line orthogonal to a straight line between the 
two end points, wherein the pixels are scanned 
from both of the end points; 25 

(c) filtering the scanned pixels using a non-liner 
filter to identify peaks which indicate a route of 
the feature; 

(d) selecting the scanned pixels with a peak 
closest to the straight line between the two end 30 
points; 

(e) fining the selected pixels with a least 
squares fitting line utilizing a robust method; 

(f) setting the two end points to the location of 

the last selected pixel for each of the tracking 35 
branches and repeating steps (b) through (f) 
until the tracking branches approximately inter- 
sect; and 

(g) fining the tracking branches with a least 
squares error line utilizing the robust method. 40 

26. The method of claim 25, wherein the nonlinear filter 
is a trimmed contraharmonic filter and Ransac is 
the robust method utilized. 

45 

27. A method of determining in VHR satellite data the 
location of a pipeline, the method comprising the 
steps of: 



obtaining an indication of a pipeline route from so 
GPS data; 

obtaining the VHR satellite data; and 
processing the VHR satellite data to align it 
with the pipeline route indicated by the GPS 
data. 55 
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